Image processing apparatus, system, method, and medium

ABSTRACT

An image processing apparatus capable of communicating with an external apparatus via a network includes, a combining unit configured to combine a plurality of images captured under different exposure conditions, an exposure setting unit configured to acquire an image under a set exposure condition, a reception unit configured to receive a command for specifying an operation of the combining unit and the exposure setting unit from the external apparatus, and a first control unit configured to control a timing of the operation of the exposure setting unit, specified by the command received by the reception unit, based on an operation state of at least one of the combining unit and the exposure setting unit.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Divisional of U.S. application Ser. No.14/747,813, filed Jun. 23, 2015, which claims the benefit of priorityfrom Japanese Patent Application No. 2014-130671 filed Jun. 25, 2014,each of which is hereby incorporated by reference herein in theirentirety.

BACKGROUND OF THE INVENTION

Field of the Invention

The present disclosure generally relates to image processing, and moreparticularly relates to an image processing apparatus, system, method,and medium that combines pieces of image data obtained under differentexposure conditions.

Description of the Related Art

A conventionally known image processing apparatus, such as an imagingapparatus, combines a long-exposure signal and a short-exposure signalto achieve an image with a wider dynamic range (Japanese PatentApplication Laid-Open No. 2008-236142). For example, the followingtechnique can be employed as another method with which an image with awide dynamic range can be captured. Specifically, a processing conditionsuch as a gain is changed for adjusting a dynamic range, whereby asubject involving a brightness difference, backlight in particular, iscorrected.

On the other hand, a standard protocol has been known with which acommon communication interface is established between the imagingapparatus and an external apparatus that communicates with the imagingapparatus via a network. A common standard established by Open NetworkVideo Interface Forum (hereinafter, referred to as ONVIF as appropriate)has been known as an example of the standard protocol. In the protocol,ImagingSettings has been defined as a set of control commands related tovarious processing conditions about image quality and the like tocontrol the imaging apparatus from the external apparatus.

SUMMARY OF THE INVENTION

However, with the technique of correcting the subject with thebrightness difference described above, some images may have degradedimage quality. Furthermore, when a combination of the correction withprocessing of achieving a wider dynamic range is performed, a problemoccurs in which the resultant composite image is degraded due to aconfiguration and timing.

According to an aspect of the present disclosure, an image processingapparatus capable of communicating with an external apparatus via anetwork includes, a combining unit configured to combine a plurality ofimages captured under different exposure conditions, an exposure settingunit configured to acquire an image under a set exposure condition, areception unit configured to receive a command for specifying anoperation of the combining unit and the exposure setting unit from theexternal apparatus, and a first control unit configured to control atiming of the operation of the exposure setting unit, specified by thecommand received by the reception unit, based on an operation state ofat least one of the combining unit and the exposure setting unit.

Further features of the present disclosure will become apparent from thefollowing description of exemplary embodiments with reference to theattached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram illustrating an example of a system configuration ofa monitoring system according to a first exemplary embodiment of thepresent disclosure.

FIG. 2 is a block diagram illustrating an example of a hardwareconfiguration of a monitoring camera according to the first exemplaryembodiment of the present disclosure.

FIG. 3 is a block diagram illustrating an example of a hardwareconfiguration of a client apparatus according to the first exemplaryembodiment of the present disclosure.

FIG. 4 is a sequence diagram illustrating a command sequence between themonitoring camera and the client apparatus according to the firstexemplary embodiment of the present disclosure.

FIG. 5 is a sequence diagram illustrating a command sequence of themonitoring camera and the client apparatus according to the firstexemplary embodiment of the present disclosure.

FIGS. 6A to 6E are diagrams illustrating examples of definitions of anImagingSettings type according to the first exemplary embodiment of thepresent disclosure.

FIGS. 7A to 7C are diagrams illustrating examples of commandconfigurations in SetImagingSettings transactions according to the firstexemplary embodiment of the present disclosure.

FIGS. 8A to 8C are diagrams illustrating examples of commandconfigurations in SetImagingSettings transactions according to the firstexemplary embodiment of the present disclosure.

FIG. 9 is a flowchart illustrating wide dynamic range (WDR) and darkarea compensation (DC) operations via an ImagingSettings commandaccording to the first exemplary embodiment of the present disclosure.

DESCRIPTION OF THE EMBODIMENTS

Various exemplary embodiments, features, and aspects of the inventionwill be described in detail below with reference to the drawings.

The configuration described in the following exemplary embodiment ismerely an example. The present disclosure is not limited to anillustrated configuration. Commands and coordinate systems in thefollowing exemplary embodiment are determined based on the Open NetworkVideo Interface Forum (ONVIF) standard, for example, but are not limitedto these commands and coordinate systems.

A network configuration according to a first exemplary embodiment isdescribed with reference to FIG. 1. More specifically, FIG. 1 is adiagram illustrating an example of a system configuration of amonitoring system according to the present exemplary embodiment.

In the monitoring system according to the present exemplary embodiment,a monitoring camera 1000 that captures a video and a client apparatus2000 are communicably connected to each other via an Internet Protocol(IP) network 1500 (through a network). Thus, the monitoring camera 1000can distribute image data to the client apparatus 2000 through the IPnetwork 1500.

The monitoring camera 1000 according to the present exemplary embodimentis an example of an imaging apparatus or an image processing apparatus.The client apparatus 2000 is an example of an external apparatus such asa personal computer (PC). The monitoring system according to the presentexemplary embodiment corresponds to an imaging system or an imageprocessing system.

For example, the IP network 1500 includes a plurality of routers,switches, cables, and the like compliant with a communication standardsuch as Ethernet (registered trademark). In the present exemplaryembodiment, any communication standard, scale, and configuration may beemployed as long as communications between the monitoring camera 1000and the client apparatus 2000 can be performed.

For example, the IP network 1500 may be formed of the Internet, a wiredlocal area network (LAN), a wireless LAN, a wide area network (WAN), orthe like. For example, the monitoring camera 1000 according to thepresent exemplary embodiment may be compliant with Power Over Ethernet(PoE) (registered trademark), and may receive power supply through a LANcable.

The client apparatus 2000 transmits various commands as control commandsto the monitoring camera 1000. For example, the commands include acommand for changing an imaging direction and an angle of view of themonitoring camera 1000, a command for changing an imaging parameter, anda command for starting image streaming.

On the other hand, the monitoring camera 1000 transmits a response(response command) and a streaming image to the client apparatus 2000,in response to the commands. The monitoring camera 1000 changes theangle of view in response to a command for changing the angle of viewreceived from the client apparatus 2000. The monitoring camera 1000changes a parameter used for imaging and a parameter used for imageprocessing, in response to a command for changing the imaging parameterreceived from the client apparatus 2000.

FIG. 2 is a block diagram illustrating an example of a hardwareconfiguration of the monitoring camera 1000 according to the presentexemplary embodiment.

A control unit 1001 illustrated in FIG. 2 performs overall control oncomponents of the monitoring camera 1000. The control unit 1001 isformed of a central processing unit (CPU). The control unit 1001executes a program stored in a storage unit 1002. Alternatively, thecontrol unit 1001 may perform the control with hardware. As used herein,the term “unit” generally refers to any combination of software,firmware, hardware, or other component, such as circuitry, that is usedto effectuate a purpose.

The storage unit 1002 is mainly used as a storage area for various datasuch as a storage area for the program executed by the control unit1001, a work area during the execution of the program, and a storagearea for image data generated by an imaging unit 1004 described below.The storage unit 1002 stores a parameter (image processing setting) usedfor various types of processing in blocks in the monitoring camera 1000,a parameter set by the client apparatus 2000, and the like.

A communication unit 1003 transmits and receives each control command toand from the client apparatus 2000. The communication unit 1003 performsappropriate packet processing on a communication content (data and thelike), and the resultant content is temporarily stored in the storageunit 1002 or a buffer provided in the communication unit 1003 and thelike. The imaging unit 1004 includes an imaging optical system, animaging device such as a charged coupled device (CCD) sensor and acomplementary metal-oxide-semiconductor (CMOS) sensor (not illustrated),and the like. The imaging unit 1004 generates an analog signal bycapturing an image of a subject focused by the imaging optical system.The imaging unit 1004 converts the generated analog signal into digitaldata.

The imaging unit 1004 outputs the digital data obtained by theconversion, as the image data, to the storage unit 1002, an exposurecompensation processing unit 1005, and a wide dynamic range imagecombining processing unit 1006.

The exposure compensation processing unit 1005 analyzes the image dataoutput from the imaging unit 1004, and executes exposure correctionprocessing partially or entirely on the image data, based on an exposuresetting and an image processing setting stored in the storage unit 1002.The exposure compensation processing unit 1005 outputs the image data asa result of the exposure correction processing to the storage unit 1002.

The exposure correction processing includes color tone correctionprocessing. The color tone correction processing is processing ofgenerating image data having color tone or exposure corrected to beappropriate so that visibility of at least one of excessively-bright andexcessively-dark areas is improved.

The exposure correction processing in the present exemplary embodimentincludes backlight compensation processing and dark area compensationprocessing. The backlight compensation processing is processing in whichthe entire image data including a dark area in a backlight state(backlight condition) becomes brighter. The dark area compensationprocessing is processing in which a dark area (dark condition) in theimage data is identified, and the identified dark area is corrected tobe bright while maintaining the brightness of an image in a bright area.

The exposure correction processing in the present exemplary embodimentinvolves an exposure setting function of setting an exposure conditionof the imaging unit 1004. The exposure condition includes an aperturevalue of the imaging optical system in the imaging unit 1004 as well asexposure time (accumulation time), an imaging gain, and the like of theimaging device in the imaging unit 1004.

The exposure compensation processing unit 1005 in the present exemplaryembodiment corresponds to an exposure setting unit that sets theexposure condition of the imaging unit 1004 and acquires a single pieceof image data generated by the imaging unit 1004 by capturing the imageof the subject under the set exposure condition.

The wide dynamic range (hereinafter referred to as WDR as appropriate)image combining processing unit 1006 executes wide dynamic rangeprocessing (hereinafter referred to as WDR processing as appropriate).

The WDR image combining processing unit 1006 acquires images processedby the exposure compensation processing unit 1005 based on a pluralityof images captured under different exposure conditions, output from theimaging unit 1004. The WDR image combining processing unit 1006determines and combines portions with optimum brightness in theplurality of images after the processing. Thus, a single piece ofcomposite image data with a wide dynamic range is generated. The WDRimage combining processing unit 1006 outputs the generated compositeimage data to the storage unit 1002.

Thus, the WDR image combining processing unit 1006 according to thepresent exemplary embodiment corresponds to a combining unit thatcombines a plurality of pieces of image data, generated by the imagingunit 1004 by capturing images of the subject under different exposureconditions, to generate composite image data.

A compression encoding unit 1007 executes compression encodingprocessing on the image data output from the imaging unit 1004, theexposure compensation processing unit 1005, and the WDR image combiningprocessing unit 1006, based on the compression encoding setting and aformat such as Joint Photographic Experts Group (JPEG), H.264, or H.265.The compression encoding unit 1007 outputs the image data as a result ofthe compression encoding processing to the storage unit 1002.

When the client apparatus 2000 requests streaming distribution, themonitoring camera 1000 according to the present exemplary embodimentperforms the streaming distribution of the image data, output from thecompression encoding unit 1007, to the outside through the communicationunit 1003 in response to the request.

In FIG. 2, the exposure compensation processing unit 1005 and the WDRimage combining processing unit 1006 are connected in series. However,it is not limited thereto. The exposure compensation processing unit1005 and the WDR image combining processing unit 1006 may be connectedin parallel, or may be arranged in a reversed order.

In FIG. 2, the monitoring camera 1000 includes the imaging unit 1004.However, when an image stored in the storage unit 1002 is mainly used,the imaging unit 1004 does not necessarily need to be provided.

FIG. 3 is a block diagram illustrating an example of a hardwareconfiguration of the client apparatus 2000 according to the presentexemplary embodiment. The client apparatus 2000 according to the presentexemplary embodiment is a computer apparatus connected to the IP network1500.

A control unit 2001 in FIG. 3 controls the entire client apparatus 2000.For example, the control unit 2001 includes a CPU, and executes aprogram stored in a storage unit 2002 described below. Alternatively,the control unit 2001 may perform the control with hardware. The storageunit 2002 is used as a storage area for the program executed by thecontrol unit 2001, a work area during the execution of the program, anda data storage area.

A communication unit 2003 receives an instruction from the control unit2001 and transmits a command and the like to the monitoring camera 1000.Furthermore, the communication unit 2003 receives a response withrespect to the command and image data transmitted by the streamingdistribution, and the like, from the monitoring camera 1000.

For example, an input unit 2004 includes a button, a cross key, a touchpanel, a mouse, and the like. The input unit 2004 receives aninstruction input from a user. For example, the input unit 2004 canreceive an instruction to transmit various commands to the monitoringcamera 1000, as an instruction from the user.

When the command transmission instruction to the monitoring camera 1000is input from the user, the input unit 2004 notifies the control unit2001 that the instruction has been input. The control unit 2001generates a command to the monitoring camera 1000 in accordance with theinstruction input to the input unit 2004. Then, the control unit 2001instructs the communication unit 2003 to transmit the generated commandto the monitoring camera 1000.

The input unit 2004 can receive a response to an inquiry message to theuser, generated by the control unit 2001 by executing a program storedin the storage unit 2002, input by the user.

A decoding unit 2005 decodes and decompresses the image data output fromthe communication unit 2003. The decoding unit 2005 outputs the decodedand decompressed image data to a display unit 2006. Thus, the displayunit 2006 displays an image corresponding to the image data output fromthe decoding unit 2005.

The display unit 2006 can display the inquiry message to the user,generated by the control unit 2001 executing a program stored in thestorage unit 2002, for example.

The inner configuration of each of the monitoring camera 1000 and theclient apparatus 2000 is described above. The processing blocksillustrated in FIG. 2 and FIG. 3 are for describing a preferredexemplary embodiment of the imaging apparatus and the external apparatusaccording to the present disclosure, and it is not limited thereto.Various modifications and changes can be made without departing from thegist of the present disclosure. For example a voice input unit or avoice output unit may be provided.

FIG. 4 illustrates a typical command sequence between the monitoringcamera 1000 and the client apparatus 2000 during the time period fromsetting start to video distribution.

Each transaction in the present exemplary embodiment includes a pair ofa command transmitted from the client apparatus 2000 to the monitoringcamera 1000 and a response transmitted from the monitoring camera 1000to the client apparatus 2000 in response to the command.

Various parameters referred to in the description of FIG. 4 aredescribed below.

MediaProfile is a set of parameters for associating and storing varioussetting items of the monitoring camera 1000, and includes ProfileTokenas an identification (ID) of MediaProfile, VideoSourceConfiguration, andVideoEncoderConfiguration, as well as links to various setting itemsincluding a voice encoder and the like.

VideoSource is a set of parameters indicating a performance of a singleimaging unit 1004 of the monitoring camera 1000, and includesVideoSourceToken as an ID of VideoSource and Resolution indicating aresolution of image data that can be output by the imaging unit 1004.

VideoSourceConfiguration (hereinafter, referred to as VSC asappropriate) is a set of parameters for associating VideoSource of themonitoring camera with MediaProfile. VideoSourceConfiguration includesBounds specifying an area of the image data, which is output based onVideoSource, to be segmented as a distributed image.

VideoEncoderConfiguration (hereinafter, referred to as VEC asappropriate) is a set of parameters for associating an encoder settingrelated to compression encoding for image data with MediaProfile. Themonitoring camera 1000 performs compression encoding on image dataoutput based on VideoSource and VSC in accordance with a parameter suchas a compression encoding system (for example, JPEG or H.264), framerate, or resolution set in the VEC. The resultant image data isdistributed to the client apparatus 2000 through the communication unit1003.

VideoEncoderConfiguration includes VideoEncoderConfigurationToken as anID of VideoEncoderConfiguration and Encoding indicating the compressionencoding method. VideoEncoderConfiguration further includes Resolutionindicating the resolution of an output image, Quality indicatingcompression encoding quality, FramerateLimit indicating the maximumframe rate of the output image, and BitrateLimit indicating the maximumbit rate.

In transaction T6000 for network device connection, the client apparatus2000 transmits a Probe command for establishing connection with anetwork device to the IP network 1500 through unicast or multicast. Themonitoring camera 1000 connected to the IP network 1500 transmits aProbeMatch response, indicating that the command can be received, to theclient apparatus 2000.

In transaction T6001 for a Subscribe command, the client apparatus 2000can instruct the monitoring camera 1000 to perform event distribution.

In transaction T6002 for a GetProfiles command, the client apparatus2000 acquires a list of MediaProfile held by the monitoring camera 1000.

In transaction T6003 for a GetVideoSources command, the client apparatus2000 acquires a list of VideoSource held by the monitoring camera 1000.

In transaction T6004 for a GetVideoSourceConfigurations command, theclient apparatus 2000 acquires a list of VideoSourceCofiguration held bythe monitoring camera 1000.

The client apparatus 2000 transmits the GetVideoSourceConfigurationscommand to the monitoring camera 1000. The monitoring camera 1000 thathas received the GetVideoSourceConfigurations command transmits a listincluding an ID of the VSC held by the monitoring camera 1000 to theclient apparatus 2000 as a response.

In transaction T6005 for a GetVideoEncoderConfigurationsm command, theclient apparatus 2000 acquires the list of VEC held by the monitoringcamera 1000.

The client apparatus 2000 transmits the GetVideoEncorderConfigurationscommand to the monitoring camera 1000. The monitoring camera 1000 thathas received the command transmits a response with respect to thecommand.

In transaction T6006 for a GetVideoEncoderConfigurationOptions command,the client apparatus 2000 acquires options of each parameter and a rangeof the setting value that can be received by the monitoring camera 1000in the VEC specified by the ID.

The client apparatus 2000 transmits theGetVideoEncorderConfigurationOptions command to the monitoring camera1000. The monitoring camera 1000 that has received the command transmitsa response with respect to the command. In this transaction, the clientapparatus 2000 acquires a list including an ID of the compressionencoding setting stored in the storage unit 1002 from the monitoringcamera 1000.

In transaction T6007 for a CreateProfile command, the client apparatus2000 creates new MediaProfile in the monitoring camera 1000 and acquiresProfileToken corresponding thereto. After this transaction, themonitoring camera 1000 transmits a MediaProfile change notificationevent for notifying the client apparatus 2000 on the network that acertain change has been made on MediaProfile.

In this transaction, the client apparatus 2000 can newly create adistribution profile in the monitoring camera 1000 and can acquire an IDof the created distribution profile. The monitoring camera 1000 storesthe newly created distribution profile.

In transactions T6008 and T6009 for an AddVideoSourceConfigurationcommand and an AddVideoEncoderConfigurtion command, respectively, byspecifying an ID, the client apparatus 2000 can associate the desiredVSC and VEC with the specified MediaProfile. After these transactions,the monitoring camera 1000 transmits the MediaProfile changenotification event for notifying the client apparatus 2000 on thenetwork that a certain change has been made on MediaProfile.

In transaction T6010 for a SetVideoEncoderConfiguration command, themonitoring camera 1000 that has received the command transmits aresponse with respect to the command. In the transaction, the clientapparatus 2000 sets the content of the VEC acquired in transaction T6005based on the options acquired in transaction T6006. For example, thecompression encoding system and the segmentation size are changed. Themonitoring camera 1000 stores the content such as the compressionencoding setting thus set.

With this command, the client apparatus 2000 sets the parameters of theVEC. After the transaction, the monitoring camera 1000 transmits a VECchange notification event for notifying the client apparatus 2000 on thenetwork that a certain change has been made on the VEC.

In transaction T6011 for a GetStreamUri command, the client apparatus2000 acquires an address (URI) with which the monitoring camera 1000performs the streaming distribution based on the specified MediaProfilesetting.

The monitoring camera 1000 transmits, to the client apparatus 2000 as aresponse, the address for performing the streaming distribution of animage corresponding to contents of the VSC and the VEC associated withthe distribution profile ID specified by the client apparatus 2000.

In transaction T6012 for a DESCRIBE command, the client apparatus 2000requests and acquires information on a content of the streamingdistribution by the monitoring camera 1000, by executing the commandusing the URI acquired in transaction T6011.

In transaction T6013 for a SETUP command, the client apparatus 2000executes the command by using the URI acquired in transaction T6011 sothat a stream distribution method including a session number is sharedbetween the client apparatus 2000 and the monitoring camera 1000.

In transaction T6014 for a PLAY command, the client apparatus 2000requests the monitoring camera 1000 to start the streaming, by executingthe command using the session number acquired in transaction T6013.

In transaction T6015 for stream distribution, the monitoring camera 1000performs the streaming distribution, requested to be started intransaction T6014, using the distribution method shared in transactionT6013.

In transaction T6016 for a TEARDOWN command, the client apparatus 2000requests the monitoring camera 1000 to stop the stream distribution byexecuting the command using the session number acquired in transactionT6013.

FIG. 5 illustrates a typical command sequence between the monitoringcamera 1000 and the client apparatus 2000 for image processing settingImagingSetting change.

In transaction T6050 for a GetServices command, the client apparatus2000 acquires a type of a Web service supported by the monitoring camera1000 and an address URI for utilizing each Web service.

The client apparatus 2000 transmits the GetServices command to themonitoring camera 1000. The monitoring camera 1000 that has received thecommand transmits a response with respect to the command.

In transaction T6051 for a GetServiceCapabilities command, the clientapparatus 2000 acquires a list of functions of each Web service acquiredin transaction T6050.

The client apparatus 2000 transmits the GetServiceCapabilities commandto the monitoring camera 1000. The monitoring camera 1000 that hasreceived the command transmits a response with respect to the command.

In transaction T6052 for a GetImagingSettings command, the clientapparatus 2000 acquires a list of image processing settingImagingSetting held by the monitoring camera 1000.

The client apparatus 2000 transmits the GetImagingSettings command tothe monitoring camera 1000. The monitoring camera 1000 that has receivedthe command transmits a response with respect to the command.

In transaction T6053 for a GetOptions command, the client apparatus 2000acquires options of a parameter of the image processing settingImagingSettings that can be received by the monitoring camera 1000.

The client apparatus 2000 transmits the GetOptions command to themonitoring camera 1000. The monitoring camera 1000 that has received thecommand transmits a response with respect to the command.

In transaction T6054 for a SetImagingSettings command, the clientapparatus 2000 transmits a new image processing setting ImagingSettingto the monitoring camera 1000 to change the image processing setting.

In transaction T6055 for an ImagingSetting change notification eventafter transaction T6054, the monitoring camera 1000 transmits theImagingSetting change notification event for notifying the clientapparatus 2000 on the network that a certain change has been made onImagingSetting.

FIGS. 6A to 6E illustrate examples of definitions of an ImagingSettingstype according to the present exemplary embodiment. In the presentexemplary embodiment, an XML Schema Definition language (hereinafter,referred to as XSD as appropriate), used in the ONVIF standard, is usedfor defining the ImagingSetttings type.

FIGS. 6A to 6E illustrate contents of the ImagingSettings type. Elementsin FIG. 6A are specified to appear in the defined sequence by thesequence specifier.

In FIG. 6A, BacklightCompensation (hereinafter, referred to as BLC asappropriate) is a parameter for turning ON and OFF the backlightcompensation. The BLC may be omitted with a minOccurs specifier in XSD.

Brightness is a parameter for specifying the brightness of an imagecaptured by the imaging unit 1004. The Brightness may be omitted byusing the minOccurs specifier in XSD. ColorSaturation is a parameter forindicating a color saturation of an image captured by the imaging unit1004. The ColorSaturation may be omitted by the minOccurs specifier inXSD.

Contrast is a parameter for specifying a color density of the imagecaptured by the imaging unit 1004. This Contrast may be omitted by usingthe minOccurs specifier in XSD. Exposure is a parameter for changingexposure of the image captured by the imaging unit 1004. This Exposuremay be omitted by using the minOccurs specifier in XSD.

Focus is a parameter for changing focus setting of the imaging unit1004. This Focus may be omitted by using the minOccurs specifier in XSD.IrCutFilter is a parameter for changing a setting of an infrared cutfilter (IRCF) that can be inserted to and removed from an optical pathof the imaging optical system in the imaging unit 1004.

The IRCF is a filter for blocking infrared light. This IRCutFilter maybe omitted by using the minOccurs specifier in XSD.

Sharpness is a parameter for changing a setting of sharpness of theimage captured by the imaging unit 1004. This Sharpness may be omittedby using the minOccurs specifier in XSD.

WideDynamicRange is a parameter for changing a setting of WDR processingexecuted by the WDR image combining processing unit 1006. ON and OFF canbe set as a value of the WideDynamicRange. This WideDynamicRange may beomitted by using the minOccurs specifier in XSD.

WideDynamicRange with the value set to be ON indicates that the WDRprocessing in the monitoring camera 1000 is ON. WideDynamicRange withthe value OFF indicates that the WDR processing in the monitoring camera1000 is OFF. Thus, the SetImagingSettings command in the presentexemplary embodiment corresponds to a combining command for controllingthe operation of the WDR image combining processing unit 1006.

WhiteBalance is a parameter for adjusting white balance of the imagecaptured by the imaging unit 1004. WhiteBalance may be omitted by usingthe minOccurs specifier in XSD. Extention includes an extended parameteras in FIG. 6B and the like. This Extention may be omitted by using theminOccurs specifier in XSD.

FIGS. 6B to 6E illustrate parameters added to ImagingSettingsillustrated in FIG. 6A. The parameters are part of the image processingsetting as in the case of the parameters in FIG. 6A.

ImageStabilization in FIG. 6B is a parameter for setting an imagestabilization function for the image captured by the imaging unit 1004.Elements in FIG. 6B are specified by the sequence specifier to appear inthe defined sequence.

IrCutFilterAutoAdjustment in FIG. 6C is a parameter for settinginformation (luminance of the subject and delay time) used when the IRCFis inserted and removed. Elements in FIG. 6C are specified by thesequence specifier to appear in the defined sequence.

ImageStabilization and IrCutFilterAutoAdjustment may be omitted by usingthe minOccurs specifier in XSD.

DarknessCompensation in FIG. 6D is a parameter for setting the dark areacompensation function of the exposure compensation processing unit 1005.The dark area compensation function is for detecting dark and brightareas in the image captured by the imaging unit 1004 and compensatingonly the dark area to be bright. Elements in FIG. 6D are specified bythe sequence specifier to appear in the defined sequence.

DarknessCompensation is hereinafter referred to as DC as appropriate.DarknessCompensation may be omitted by using the minOccurs specifier inXSD.

At least any of ON, OFF, and AUTO can be set as a value of the DC(operation specification). The DC with the value set to be ON indicatesthat the dark area compensation function in the monitoring camera 1000is ON. The DC with the value set to be OFF indicates that the dark areacompensation function in the monitoring camera 1000 is OFF. The DC withthe value set to AUTO indicates that the monitoring camera 1000automatically determines whether the dark area compensation function isto be ON or OFF (operation specification).

Thus, the SetImagingSettings command in the present exemplary embodimentcorresponds to an exposure setting command for specifying (controlling)the operation of the exposure compensation processing unit 1005.

Thus, in transaction T6053 for the GetOptions command in the presentexemplary embodiment, the options described above relating to WDR, BC,and DC are transmitted as settable parameters to the client apparatus2000 as a response.

The WDR with the value set to be ON in transaction T6054 for theSetImagingSettings command in FIG. 5 can be additionally provided with aLevel parameter for specifying an effective level. However, thedescription of Level is omitted herein. Similarly, the DC with the valueset to be ON in this transaction can be additionally provided with aLevel parameter for specifying an effective level. However, thedescription of Level is omitted herein.

FIGS. 7A to 7C illustrate configuration examples of theSetImagingSettings command in transaction T6054 in FIG. 5. FIG. 7Aillustrates a configuration of the SetImagingSettings command fornotifying the WDR setting parameter 7002 of WDR and the DC settingparameter 7003 described above from the client apparatus 2000 to themonitoring camera 1000. The setting parameters represent a case whereWDR is ON, Level indicating the effective level of WDR is 1.0, and DC isOFF. Thus, a plurality of image processing parameters may besimultaneously set in the monitoring camera 1000 by theSetImagingSettings command from the client apparatus 2000. Thesesettings are not dependent on the state of the monitoring camera 1000,and thus the monitoring camera 1000 cannot recognize what parameters areset and when they are set.

FIG. 7B illustrates a case where WDR is ON, Level indicating the levelof WDR is 1.0, DC is ON, and Level indicating the level of DC is 1.0.FIG. 7C illustrates a case where WDR is ON, Level indicating the levelof WDR is 1.0, DC is AUTO, and Level indicating the level in AUTO is1.0.

On the other hand, FIGS. 8A to 8C illustrate the SetImagingSettingscommand when the setting parameter of the WDR is OFF. More specifically,FIG. 8A illustrates a case where the WDR is OFF and DC is OFF. FIG. 8Billustrates a case where the WDR is OFF, DC is ON, and Level indicatingthe level of DC is 1.0. FIG. 8C illustrates a case where WDR is OFF, DCis AUTO, and Level indicating level in AUTO is 1.0. Here, Levels are all1.0. However, this is merely an example, and a Level may take adifferent value.

FIG. 9 is a flowchart illustrating operations performed when themonitoring camera 1000 receives from the client apparatus 2000 aSetImagingSettings command illustrated in FIGS. 7A to 7C or FIGS. 8A to8C. The control unit 1001 starts the processing in this flowchart uponreceiving the SetImagingSettings command transmitted from the clientapparatus 2000 and the like through the communication unit 1003.

In step S9001, the control unit 1001 analyzes a description content ofthe received SetImagingSettings command, and compares the descriptioncontent with the current operation content to determine whether thesetting of WDR is changed by the received command. When the settingchanges (YES in step S9001), the processing proceeds to step S9002. Onthe other hand, when the setting does not change (NO in step S9001), theprocessing proceeds to step S9005.

In step S9002, the control unit 1001 analyzes the description content ofthe received SetImagingSettings command and compares the descriptioncontent with the current operation content to determine whether thesetting of DC is changed by the received command. When the settingchanges (YES in step S9002), the processing proceeds to step S9003. Onthe other hand, when the setting does not change (NO in step S9002), theprocessing proceeds to step S9004.

In step S9003, the control unit 1001 causes reflection of the setting(operation timing) specified by the received SetImagingSettings commandto be delayed to a time point at which a combining start frame in theWDR processing is captured. More specifically, when a plurality ofimages captured under different exposure conditions is acquired to becombined for the WDR processing, an operation of changing a setting ofcorrection processing and the like collectively on all the plurality ofimages is performed as a unit. Thus, the DC is turned ON for the imagesused in the WDR processing, whereby the resultant composite image isless likely to be abnormal so that processing can be prevented frombeing inconsistent. One example of the inconsistent processing is a casewhere three images combined in the WDR processing include two imagescaptured with DC turned ON and a remaining image captured with DC turnedOFF. After reflecting the setting, the control unit 1001 transmits aresponse to the client apparatus 2000, and the processing is terminated.

In step S9004, the control unit 1001 reflects the setting specified bythe received SetImagingSettings command from a subsequent frame. Thus,the setting is immediately reflected, so that the WDR processing startsfrom the subsequent frame. Here, the setting of WDR is changed but thesetting of DC is not changed, whereby processing is prevented from beinginconsistent, and the resultant composite image is less likely to beabnormal. After reflecting the setting, the control unit 1001 transmitsa response to the client apparatus 2000, and the processing isterminated.

On the other hand, in step S9005, the control unit 1001 determines thecurrent WDR operation state. More specifically, whether the WDRprocessing is being executed is determined. When the processing is beingexecuted (YES in step S9005), the processing proceeds to step S9006. Onthe other hand, when the processing is not being executed (NO in stepS9005), the processing proceeds to step S9007.

In step S9006, the control unit 1001 causes the setting specified by thereceived SetImagingSettings command to be delayed to a time point atwhich a combining start frame in the WDR processing is captured. Morespecifically, when a plurality of images captured under differentexposure conditions is acquired to be combined for the WDR processing,an operation of changing a setting of correction processing and the likecollectively on all the plurality of images is performed as a unit.Thus, the processing can be prevented from being inconsistent. Afterreflecting the setting, the control unit 1001 transmits a response tothe client apparatus 2000, and the processing is terminated.

In step S9007, the control unit 1001 reflects the setting specified bythe received SetImagingSettings command from a subsequent frame. Thus,the setting is immediately reflected, so that the WDR processing startsfrom the subsequent frame. Here, the setting of WDR is changed but thesetting of DC is not changed, whereby processing is prevented from beinginconsistent, and the resultant composite image is less likely to beabnormal. After reflecting the setting, the control unit 1001 transmitsa response to the client apparatus 2000, and the processing isterminated.

As described above, the monitoring camera 1000 in the present exemplaryembodiment checks the latest states of WDR and DC, and executesappropriate processing. Thus, the quality of the WDR composite image canbe prevented from degrading. More specifically, with the operation ofthe monitoring camera 1000 according to the present exemplaryembodiment, the image quality can be prevented from being abnormal evenwhen interfering correction processing setting is set while theprocessing, such as the WDR processing, collectively performed on aplurality of images is being executed.

The transmission of WDR and DC setting values and the setting of Levelsfor the DC and WDR, performed in the present exemplary embodiment, caneach be omitted.

The case where the WDR processing and the DC processing are combined isexemplified in the present exemplary embodiment. Alternatively,color-gradation correction processing, backlight compensationprocessing, dark area compensation processing, and the like may replacethe processing or may be further combined.

In step S9003 and the like in FIG. 9, the operation of causing thereflection of the setting to be delayed to the combining start frame ofthe WDR is exemplified. However, it is not limited thereto. For example,instead of causing the reflection of the setting to be delayed, theabnormal image may be discarded so as not to be transmitted to theclient apparatus 2000. More specifically, the delayed amount iscontrolled in such a manner that the image transmission operation isdelayed to the next WDR combining start frame. This operation canprevent the adverse effect of the abnormal image. An operation ofcopying a previous frame may be performed for delaying the imagetransmission operation. Furthermore, only the abnormal image may bediscarded and the WDR processing may be executed with the smaller numberof images.

In step S9003 and the like in FIG. 9, the operation of causing thereflection of the setting to be delayed to the combining start frame ofthe WDR is exemplified. However, it is not limited thereto. For example,even when the DC setting changes, the delaying may not be required whenthe value of DC is set to AUTO before and after the change. Morespecifically, when the value of DC is set to AUTO, the monitoring camera1000 automatically determines whether to turn ON or OFF the dark areacompensation function. Thus, the operation might be consistent even whenthe setting value changes. Thus, whether to cause the reflection of thesetting to be delayed to the combining start frame of the WDR may bedetermined further based on the result of determination with AUTO(specification result).

The response is transmitted when the processing is terminated (after thesetting is reflected) in FIG. 9. Alternatively, the timing at which theresponse is transmitted (transmission timing) may be before the settingis reflected, or may be delayed by a predetermined time period.

The present disclosure may be implemented by executing the followingprocessing. More specifically, software (program) for implementing thefunctions in the exemplary embodiment described above is provided to asystem or an apparatus through a network or a various computer-readablestorage medium. Then, a computer (or a CPU, microprocessing unit (MPU),or the like) of the system or the apparatus reads out and executes thecomputer program.

The exemplary embodiments of the present disclosure have been describedabove. However, the present disclosure is not limited to the exemplaryembodiments, and can be modified and changed in various ways withoutdeparting from the spirit of the present disclosure.

Other Embodiments

Embodiments of the present disclosure can also be realized by a computerof a system or apparatus that reads out and executes computer executableinstructions recorded on a storage medium (e.g., a non-transitorycomputer-readable storage medium) to perform the functions of one ormore of the above-described embodiment(s) of the present disclosure, andby a method performed by the computer of the system or apparatus by, forexample, reading out and executing the computer executable instructionsfrom the storage medium to perform the functions of one or more of theabove-described embodiment(s). The computer may comprise one or more ofa CPU, microprocessing unit (MPU), or other circuitry, and may include anetwork of separate computers or separate computer processors. Thecomputer executable instructions may be provided to the computer, forexample, from a network or the storage medium. The storage medium mayinclude, for example, one or more of a hard disk, a random-access memory(RAM), a read only memory (ROM), a storage of distributed computingsystems, an optical disk (such as a compact disc (CD), digital versatiledisc (DVD), or Blu-ray Disc (BD)™), a flash memory device, a memorycard, and the like.

While the present disclosure has been described with reference toexemplary embodiments, it is to be understood that the disclosure is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all such modifications and equivalent structures andfunctions.

What is claimed is:
 1. An image processing apparatus communicating withan external apparatus via a network, the image processing apparatuscomprising: a combining unit configured to combine a plurality of imagescaptured under different exposure conditions; an exposure setting unitconfigured to acquire an image under a set exposure condition; areception unit configured to receive a command for specifying anoperation of the combining unit and the exposure setting unit from theexternal apparatus; a transmission unit configured to transmit acomposite image obtained by the combining unit to the network; adelaying unit configured to cause a transmission operation of thetransmission unit to be delayed; and a control unit configured tocontrol a delay amount by the delaying unit based on an operation stateof at least one of the combining unit and the exposure setting unit. 2.An image processing system comprising an image processing apparatuscommunicating with an external apparatus via a network, the imageprocessing apparatus comprising: a combining unit configured to combinea plurality of images captured under different exposure conditions; anexposure setting unit configured to acquire an image under a setexposure condition; and a control unit configured to control anoperation of the exposure setting unit, and the external apparatuscomprising a transmission unit configured to transmit a command forspecifying an operation of the combining unit and the exposure settingunit from the external apparatus, wherein the control unit controls atiming of the operation of the exposure setting unit, specified by thecommand transmitted by the transmission unit, based on an operationstate of at least one of the combining unit and the exposure settingunit.
 3. A method for controlling an image processing system includingan image processing apparatus communicating with an external apparatusvia a network and including a combining unit configured to combine aplurality of images captured under different exposure conditions and anexposure setting unit configured to acquire an image under a setexposure condition, the method comprising: controlling an operation ofthe exposure setting unit in the image processing apparatus; andtransmitting a command for specifying an operation of the combining unitand the exposure setting unit from the external apparatus, wherein atiming of the operation of the exposure setting unit, specified by thetransmitted command, is controlled based on an operation state of atleast one of the combining unit and the exposure setting unit.
 4. Anon-transitory computer-readable storage medium storing a computerprogram for causing a computer to execute a method for controlling animage processing system including an image processing apparatuscommunicating with an external apparatus via a network and including acombining unit configured to combine a plurality of images capturedunder different exposure conditions and an exposure setting unitconfigured to acquire an image under a set exposure condition, themethod comprising: controlling an operation of the exposure setting unitin the image processing apparatus; and transmitting a command forspecifying an operation of the combining unit and the exposure settingunit from the external apparatus, wherein a timing of the operation ofthe exposure setting unit, specified by the transmitted command, iscontrolled based on an operation state of at least one of the combiningunit and the exposure setting unit.